METL: Managing and Integrating ETL Processes

Companies use Extract-Transform-Load (Etl) tools to save time and costs when developing and maintaining data migration tasks. Etl tools allow the definition of often complex processes to extract, transform, and load heterogeneous data into a data warehouse or to perform other data migration tasks. In larger organizations many Etl processes of different data integration and warehouse projects accumulate. Such processes encompass common sub-processes, shared data sources and targets, and same or similar operations. However, there is no common method or approach to systematically manage large collections of Etl processes. With Metl (Managing Etl) we present an Etl management approach that supports high-level Etl management. To this end we establish and implement a set of basic management operators on Etl processes, such as Match, Merge or Invert.